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Abstract 



The propagation of chaos is a central concept of kinetic theory that 
serves to relate the equations of Boltzmann and Vlasov to the dynamics of 

many-particle systems. Propagation of chaos means that molecular chaos, 
i.e., the stochastic independence of two random particles in a many-particle 
system, persists in time, as the number of particles tends to infinity. 

We establish a necessary and sufficient condition for a family of general 
n-particle Markov processes to propagate chaos. This condition is expressed 
in terms of the Markov transition functions associated to the n-particle pro- 
cesses, and it amounts to saying that chaos of random initial states propa- 
gates if it propagates for pure initial states. 

Our proof of this result relies on the weak convergence approach to the 
study of chaos due to Sznitman and Tanaka. We assume that the space in 
which the particles live is homeomorphic to a complete and separable metric 
space so that we may invoke Prohorov's theorem in our proof. 

We also show that, if the particles can be in only finitely many states, 
then molecular chaos implies that the specific entropies in the n-particle 
distributions converge to the entropy of the limiting single-particle distribu- 
tion. 
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Chapter 1 

Introduction 



1.1 Overview 

Kinetic theory is the analysis of nonequihbrium physical phenomena that 
emerge from the collective behavior of large numbers of particles. That anal- 
ysis is accomplished by the techniques of probability theory; kinetic theory 
has an inherently statistical character. One of the notions of probability the- 
ory from which one can derive Boltzmann's equation and Vlasov's equation, 
two staples of kinetic theory, is the propagation of chaos. 

The concept of propagation of chaos originated with Kac's Markovian 
models of gas dynamics ||l^. Kac invented a class of interacting particle 
systems wherein particles collide at random with each other while the density 
of particles evolves deterministically in the limit of infinite particle number. 
A nonlinear evolution equation analogous to Boltzmann's equation governs 
the particle density. Griinbaum proved the propagation of chaos along Kac's 
lines for the spatially homogeneous Boltzmann equation given existence and 
smoothness assumptions on the Boltzmann semigroup |jT^. The processes 
of Kac were further investigated with regard to their fluctuations about the 
deterministic infinite particle limit in |2S, 39, 40 1. 



McKean introduced propagation of chaos for interacting diffusions and 
analyzed what are now called McKean- Vlasov equations |21, 22 1. Indepen- 



dently, Braun and Hepp [|5[ analyzed the propagation of chaos for Vlasov 
equations and proved a central limit theorem for the fluctuations. Anal- 
ysis of the fluctuations and large deviations for McKean- Vlasov processes 
was carried out in 35 , ^ . Chorin |^] created a numerical method for the 



two dimensional Navier-Stokes equation by interleaving independent random 
walks into the discretized dynamics of interacting vortex blobs, smoothed and 
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localized patches of vorticity that move without changing shape. Propaga- 
tion of chaos has been studied in connection with this random vortex method 
|25| . Other instances of the propagation of chaos have been stud- 
30[, 14]. A thorough analysis of the convergence of numerical 
schemes based on stochastic particle methods for McKean-Vlasov equations 
in one dimension is undertaken in [Q, 37 1. 

Finally, we refer the reader to the long, informative articles by Sznit- 




man and by Meleard [24| in Springer- Ver lag's Lecture Notes in Mathe- 
matics. 

The aforementioned authors are mostly concerned with proving that 
specific systems propagate chaos, rather than the propagation of chaos per 
se. The modest purpose of this dissertation is to clarify the definition of 
propagation of chaos in general, and not to prove that any particular system 



propagates chaos. The essential content of this dissertation is Definition 4.1 
and Theorem 4^ of Chapter 

This dissertation is organized as follows. 

The rest of Chapter |l| is an informal summary of our point of view and 
contains a statement of our main theorem. We introduce general Marko- 
vian interacting particle systems and adopt a strong-sense definition of the 
propagation of chaos. We can then characterize the propagation of chaos in 
terms of the Markov transition functions that define the interacting particle 
systems. 

Chapter |2| describes the most important instances of the propagation of 
chaos. The concept of propagation of chaos is most useful in (and was indeed 
motivated by) the kinetic theories of gases, plasmas, and stellar systems. 
Boltzmann's equation for dilute gases is discussed in Section 2.1 and Vlasov's 
equation for plasmas and stellar systems is discussed in Section 2.2. 

Chapters ^ and ^ are meant to be self-contained, formal, and brisk. They 
contain the necessary background and the proofs of the theorems that fiow 
from the point of view described in Section p^ . 

Chapter |3| discusses the theorem of Sznitman and Tanaka, which is our 
main technical tool. A detailed proof of this theorem is given in Section 3.2. 
Theorem 3^ states that, if the underlying space is finite, j)-chaos entails the 
convergence of specific entropy to the entropy of p. 

Chapter Q is dedicated to the proof of our main theorem and its corol- 
laries. Although the theorems there are neither deep nor surprising, they 
should still be of interest to those who work with the propagation of chaos 
because they establish properties of the propagation of chaos which, though 
easy to take for granted, do require some proof. The proofs rely on the the- 
orem of Sznitman and Tanaka and basic properties of convergence in law. 
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Our main theorem requires the completeness of the basic space so that we 
may invoke Prohorov's theorem in its proof. 

This work was supported by the U.S. Department of Energy at the 
Lawrence Berkeley National Laboratory, at the Mathematics Department, 
under Alexandre Chorin. 

1.2 Definition of Propagation of Chaos and State- 
ment of Main Result 

Statistical mechanics and kinetic theory are probabilistic theories of many- 
body systems; their predictions are intended to be valid only when the num- 
ber of particles is very large, typically as large as Avogadro's number. The 
equations of kinetic theory are obtained by studying the limiting behavior 
of n-particle systems as n tends to infinity. A key concept in such studies is 
the propagation of chaos. 

The concept of propagation of chaos was motivated originally by the 
kinetic theories of gases and plasmas. Before we delve into these kinetic 
theories, we first set up, in this section, a very general framework for the 
study of interacting particle systems and the propagation of chaos. 

Our particles shall live in a space S. For gases and plasmas S would 
be position- velocity space, a subset of M^, but for our general purposes S 
may be any separable metric space. The state of an n-particle system is 
a point in 5", the n-fold Cartesian product of S with itself, also a metric 
space. Whether the dynamics of the n-particle system are deterministic or 
random, we desire that the future motion of a system of particles depend 
only on its current state, and not the entire history of the particles' motion. 
We stipulate that the n-particle dynamics are Markovian; the future depends 
on the past only through the present state. Markovian processes are defined 
by their transition functions, so our data includes one transition function 
Kn{s,B,t) for each n. That is, for each n, we are given the transition 
function 

Kn-.S'^x Bsn X [0, oo) — > [0, 1], 

where Bsr>. is the Borel c-algebra on 5"". The transition functions Kn have 
the following interpretation. For t > 0, s G S"*, and B S Bg^, the probability 
that the state at time t of an n-particle system belongs to B, given that the 
state was initially s, is Kn{s,B,t). The Markov property implies that the 
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transition functions satisfy the Chapman-Kolmogorov equations: 
Kn{s,B,t + t') = I K{s,ds',t')K{s',B,t) 

for all t, f > 0, s G 5", and B eBs^. 

We restrict our consideration to n-particle systems whose dynamics com- 
mute with permutations by imposing the following conditions on the tran- 
sition functions. Let n„ denote the set of permutations of {1, 2, . . . , n}. If 
vr € n„, and s = (si, S2, • • • > Sn) € S^, let 

Vr • S = (S^(i), S^(2), . . . , S7r(n))) 

and, for 5 C 5", let 

TT ■ B = {tt ■ s : s € B} . 
We suppose that the transition functions satisfy 

Kn{s,B,t)=Kn{7T-S,Tr-B,t) (1.1) 

for all permutations vr, points s, Borel sets B, and times t. 

Here, then, is the set-up. A separable metric space S is given, along with 
a sequence 

{Kr.{s,B,t)}Zi 

of Markov transition functions that satisfy the permutation condition (|l.lD , 
Kn being a transition function on S^. We have a Markovian dynamics of 
n particles, an n-particle system, for each n. Propagation of chaos, defined 
shortly, is an attribute families of particle systems, indexed by n; a family 
of n-particle systems either does or does not propagate chaos. 

In order to define the propagation of chaos we must first define the 
property of being chaotic — "chaos" for short. For each n, let pn be a 
symmetric probability measure on S", i.e., a probability measure on S"' 
such that 

p„(7r • B) = Pn{B) 

for all permutations vr and all B G Bs^- Let p be a probability measure on 
S. 
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Definition: The sequence {pn} is p-chaotic if, for any natural number k 
and any bounded continuous functions gi{s), §2(3), ... ,gk{s) on S, 

k 

lim / gi{si)g2{s2) ■ ■ ■ gk{sk)Pn{dsids2- ■ ■ dsn) = Y\ gi{s)p{ds). 

In words, a sequence probability measures on the product spaces S"' is 

yO-cliaotic if, for fixed k, the joint probability measures for the first k coordi- 
nates tend to the product measure p{dsi)p{ds2) ■ ■ ■ p{dsk) = p®^ on . If 
the measures pn are thought of as giving the joint distribution of n particles 
residing in the space 5, then {pn} is p-chaotic if k particles out of n become 
more and more independent as n tends to infinity, and each particle's dis- 
tribution tends to p. A sequence of symmetric probability measures on 5" 
is chaotic if it is p-chaotic for some probability measure p on S. 

If a Markov process on 5" begins in a random state with distribution 
the distribution of the state after t seconds of Markovian random motion can 
be expressed in terms of the transition function for the Markov process. 
The distribution at time t is the probability measure U^Pn defined by 

U^Pn{B):= I Kn{s,B,t)pn{ds) (1.2) 



for all B € Bs" ■ If Kn satisfies the permutation condition ( |1.1D then U^pn 
is symmetric whenever pn is. 
Definition: A sequence 

{K^is,B,t)}Z^ 

whose n*'* term is a Markov transition function on S"' that satisfies the 
permutation condition ji. j|j propagates chaos if, whenever {pn} is chaotic 
so is {UPpn} for any t > 0, where U'l is as defined in 

We sometimes say that a family of n-particle Markov processes propa- 
gates chaos when we really mean that the associated family of transition 
functions propagates chaos. 

It follows from the definition of propagation of chaos that for each t > 
there exists an operator on probability measures such that {Uf^pn} is 
f7j°°p-chaotic if {pn} is p-chaotic. This operator is typically nonlinear; even 
though f7j°° is derived from the linear operators C/" by taking a limit of 
sorts, it is not actually a limit of linear operators, and may be nonlinear. 
For families of interacting particle systems suited to the study of gases or 
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plasmas, the semigroup {U^}t>o is the semigroup of solution operators for 
the Boltzmann or the Vlasov equation. (The existence of the operators Ujr^ 
is part of our main theorem, stated shortly.) 

We are adopting here a strong definition of the propagation of chaos. 
Other authors |24, p. 42] p^, p. 98] have defined propagation of chaos in a 



weaker sense: a family of Markovian ra-particle processes propagates chaos 
if {[/"/?®"'} is chaotic for all p G V{S) and t > 0, where p®" is product 
measure on S". For these authors, only purely chaotic sequences of initial 
measures are required to "propagate" to chaotic sequences. This condition 
is strictly weaker than the one we adopt for our definition. For example, 
take S = {0, 1} and let 5{x) or 6x denote a. point mass set x. Tlicn, if 

K t^i '^{1,1,... ,1) if (0,0,... ,0) 
' ' ^" I Vo,...,o) if s = (0,0,... ,0) 

for all t > 0, the sequence {Kn} propagates chaos in the weak sense, but not 
in the strong sense of our definition. Under these K^s, the (5(0)-chaotic se- 
quence {(5(0,0,... ,0)} is propagated to itself, while other (5(0)-chaotic sequences 
are propagated to 5(l)-chaotic sequences, and yet other (5(0)-chaotic se- 
quences are not propagated to chaotic sequences at all. 

Our main result is a condition on the Markov transition functions for a 
family of n-particle processes that is necessary and sufficient for the prop- 
agation of chaos (in the strong sense). Before we state it we must recall 
the weak topology on probability measures and introduce some necessary 
notation. 

If X is a completely regular topological space (as normal topological 
spaces are), let V{X) denote the space of probability measures on X endowed 
with the weakest topology relative to which all the functions Ig : 'P{X) — > M 
are continuous, where 

Ig(i^) = / 9(.x)fi{ds) 
Jx 

and g ranges over the bounded and continuous real-valued functions on X. 
A sequence {/in} in V{X) converges to fi in this weak topology if 

g{x)nnids) — > / g{x)fi{dx) 
X Jx 

for all g € Cfe(X), the space of bounded and continuous real- valued functions 
on X. 
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For V a measure on S", let v denote its symmetrization: for all B G S^n, 

^(^) = ^ E ^(^•^)- 

n! ^-^ 

7rGn„ 

For fixed s G S*" and t > 0, denote by Kn{s, - ,1) the symmetrization of the 
measure Kn{s, •, t). 
For 

S = (S1,S2, ... ,Sn) e S"", 

let en(s) denote the purely atomic probability measure 

n 

e„(s) = -V5(5,) , (1.3) 
n ^-^ 

1=1 

where S{s) — Dirac's delta — denotes a point-mass at s. The function e„ 
takes ordered n-tuples to purely atomic probability measures consisting of 
n point-masses of weight ^ each. 

We can now state our main theorem. 

Main Theorem: Let S be a complete, separable metric space. Let the 
Markov transitions K.^ satisfy the permutation condition 

Propagation of chaos by the sequence {Kn} is equivalent to the following 
condition: 

For every t > there exists a continuous map 

: ViS) — > V{S) 

such that, if the sequence 

si € S", S2 € S^, S3 G 5^, . . . 

is such that {en(sn)}^i converges to p in V{S), then the sequence of sym- 
metric measures 

) n=l 

is Ui° p-chaotic. 

The necessity of the condition of the preceding theorem is an easy conse- 
quence of the definition; its sufficiency is nontrivial. Our theorem shows that 
to prove propagation of chaos it is sufficient to verify that {U^pn} is chaotic 
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when the initial measures pn G V{S^) are symmetric atomic measures of the 
form 

p^ = — S" 5{-K- s„); Sn G 5". (1.4) 
n! ^ 

7r6n„ 

This sufficient condition can come in handy. In 1977, Braun and Hepp |^] 
proved the propagation of chaos for Vlasov's equation, provided the initial 
conditions are "pure initial states" of the form (|1.4|). Sznitman [^5|, in 
1983, noted that Braun and Hepp require "purely atomic initial data" to 
propagate their chaos, implicitly suggesting that this restriction to special 
initial conditions weakens their result. Our theorem shows that it did indeed 
suffice for Braun and Hepp to verify propagation of chaos for purely atomic 
initial data. 

The theorem is proved by expressing chaos in terms of weak convergence 
of probability measures in V{V{S)) and then applying Prohorov's theorem. 
Prohorov's theorem [Q] states that a family of probability measures on 
a complete and separable metric space is relatively compact if and only if 
T is tight. Our hypothesis that S is complete ensures that V{S) is also 
complete and enables us to apply Prohorov's theorem in 'P('P(S')). Chapter 
Q is devoted to the proof of the theorem. 

The study of chaos via weak convergence in the space V{V{S)) is due to 



Sznitman |3J] and Tanaka [38|. They proved that a sequence of symmetric 
measures {pn} is p-chaotic if and only if the probability measures induced 
on V{S) by e„ converge in V{T'{S)) to S{p), a point mass at p € 7^(3). This 
device is essential to our approach and is discussed at length in Chapter |^. 
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Chapter 2 

Kinetic Theory and the 
Propagation of Chaos 



Boltzmann's equation for dilute gases and Vlasov's equation for plasmas 
govern the evolution, the change over time, of the density of particles in 
position-momentum space. The particle density changes due to interactions 
between the particles: binary collisions of molecules in a dilute gas or mu- 
tual electric forces acting between ions in a plasma. The rate of change of 
the particle density is determined by the particle density iise// through the 
particle interactions. The evolution equations of Boltzmann and Vlasov are 
nonlinear because of the way the particle density affects its own evolution. 

This chapter reviews the equations of Boltzmann and Vlasov for the 
sake of illuminating the meaning and physical relevance of the propagation 
of chaos. One may consult |^] for a more thorough treatment of kinetic 
theory. 

Section 2A presents the theory of dilute gases from the point of view 
of the propagation of chaos. First, the classic derivation of Boltzmann's 
equation is repeated in 2.1.1 . Then, in 2.1.2 , two types of n-particle systems 
are introduced that satisfy Boltzmann's equation in the infinite particle 
limit. 

Section |2.2| is about Vlasov's equation for plasmas and stellar systems. 
Vlasov's equation is introduced in |2.2.1 and rederived in terms of the prop- 
agation of chaos in 2.2.2. 



2.1 Dilute Gases 
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2.1.1 Boltzmann's equation 

In this section we summarize Boltzmann's derivation of his equation for a 
dilute gas. Our source is the first chapter of his Lectures on Gas Theory 
written over a century ago. 

Boltzmann modeled the molecules of the gas by hard spheres: balls of 
radius r that collide elastically according to simple mechanics. When a 
ball having velocity v collides with a ball having velocity w, the collision 
instantaneously changes the velocity of the first ball from v to v' and the 
velocity of the second ball from w to w'. Given the relative orientation of 
the balls at the time of impact, the, post-collisional or outgoing velocities are 
determined by the laws of conservation of energy and momentum. Suppose 
that, at the moment of impact, 1 is the unit vector parallel to the ray that 
originates at the center of the ball of velocity v and passes through the 
center of the ball of velocity w. Such a collision, which we call a (v, w : 1) 
collision, changes the velocities of the balls to 

V — > v' = V + [(w — v) • 1]1 
w — > w' = w — [(w — v) • 1]1. 

(2.1) 

A collision of type (v, w : 1) is only possible if (w — v) • 1 < 0. Except during 
collisions, which have instantaneous duration, molecules (hard spheres in 
this model) travel inertially, with unchanging velocity. Let n denote the 
number of molecules in the gas, and let the number of molecules per unit 
volume of position-momentum space be given by the density 

/(x, V, t)dxdv, 

so that the proportion of molecules which, at time t, are located in a region 
X of space and have velocities belonging to a set V of velocities is 

- I I /(x, v,t)dx(iv. 

Boltzmann's equation tells how /(x, v, t) changes due to the collisions de- 
tailed above. 

The density /(x, v, t)dxdv of molecules changes through the inertial mo- 
tion of the molecules between collisions (called free streaming) and through 
collisions between molecules. Boltzmann's equation can be written 

|^/(x, V, t)=-^r■ Vx/(x, v, t) + Q[/(x, v, t)], 
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where — v- Vx/ gives the rate of change of / due to free streaming, and Q[f], 
the collision operator applied to /, gives the rate of change of the density 
due to collisions. 

Further assumptions are needed to determine Q[f], the rate of change of 
/(x, V, t) due to collisions. We know the effect of a (v, w : 1) collision, but we 
also need to know the rate at which those collisions are occurring. Boltzmann 
assumed that the rate at which (v, w : 1) collisions are happening at a point 
X of space is proportional to r^||(w — v) • 1|| and jointly proportional to the 
densities at x of molecules having velocities v and w. These assumptions 
are the Stosszahlansatz, or collision-number-hypothesis: the rate of (v, w : 1) 
collisions at x is 

r2||(w-v)-l||/(x,v,t)/(x,w,t). (2.2) 

The rate of change of /(x, v,t) due to collisions, Q[f], equals the rate 
at which the molecules are receiving post-collisional velocities v less the 
rate at which molecules already having velocity v are colliding with other 
molecules and exchanging v for other velocities. The loss rate is easy to 
express, assuming the Stosszahlansatz: 

L[f]-=^4 [ [ /(x,v,i)/(x,w,i)||(w-v)-l||dyw, (2.3) 

where ^2 is the unit sphere in and dl indicates the normalized and uniform 
measure on the sphere 52, is the number of molecules per unit volume at 
X of velocity v that will collide with other molecules between times t and 
t + At, divided by At. 

There is a similar expression for the gain rate at which collisions are 
resulting in molecules having velocity v. Observe that a binary collision 
can only produce a post-collisional, or outgoing, velocity v if the velocities 
before collision were v -|- ((w — v) • 1)1 and w — ((w — v) • 1)1 for some w. Let 

V* = V + ((w - v) • 1)1 
w* = w — ((w — v) • 1)1. 

The number of molecules per unit volume that will end up having velocity 
v because of a collision that took place between times t and t + At, divided 
by At, equals 

G[/]:=^/ / /(x,v*,t)/(x,w*,t)||(w-v)-l||ciWw. (2.4) 
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In fact, V* = v' and w* = w'; if a (v, w : 1) collision changes v to v' and w 
to w', then a (v',w' : 1) collision changes v' to v and w' to w. It is only a 
lucky accident that v* = v', so we emphasize, by introducing new notation, 
that V* and w* are supposed to be velocities for which a (v*,w* : 1) collision 
results in a velocity v. 

The net rate of change of /(x,v, t) due to collisions equals the gain rate 
minus the loss rate: Q[f] = G[f] — L[f]. Boltzmann's equation is thus 

^/(x, V, + V ■ Vx/(x, V, t) = G[/(x, V, t)] - L[f{^, V, t)], (2.5) 



where G[f] and L[f] are as defined in (2^) and ( |2.3| ). 



The existence of solutions of Boltzmann's equation ( |2.5| ) is difficult to 
prove. The state of the art is the global existence of mild solutions proved 
by Di Perna and Lions [^. 

2.1.2 Particle systems for Boltzmann's equation 



Kac ]17|], in his article Foundations of Kinetic Theory of 1954, propounds the 
relationship between Boltzmann's equation and certain n-particle Marko- 
vian jump processes. These n-particle systems are inherently stochastic; 
the collisions have random results and happen at random times. The dy- 
namics are not the true dynamics of deterministically colliding molecules, 
rather, the stochastic motion of fictitious particles which obey the spatially 
homogeneous Boltzmann equation on the macroscopic level. 

The spatially homogeneous Boltzmann equation is the equation satisfied 
by a position-velocity density that does not depend on position: f{v)dv. So 
Kac imagines a gas of n particles on the line, particles whose positions are 
unimportant and are not given, but whose velocities 

Vi, f2, • • • , Vn] Vi £R (2.6) 

completely specify the state of the gas. Kac proposes a stochastic dynamics 
of these states driven by collisions between pairs of particles. Suppose that 
the state is initially given by the list ( |2.6D . At a random time, a collision 
occurs. A collision changes the values of a random pair of the n velocities 
in the list, at random. Once the state of the gas has jumped to a new state 
due to a collision, another random time elapses, another collision occurs, 
and so forth. The random times are taken to be independent and to have 
exponential distributions with mean duration r/n; the probability that a 
collision happens later than t seconds after the previous collision is e""*/"^. 
Notice that the more particles there are, the faster collisions are occurring. 
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Each collision only affects the velocities of two particles, the affected pair 
being selected at random from one of the n{n — l)/2 possible pairs of parti- 
cles. Given that a pair of particles having velocities v and w collide, those 
two velocities change to another pair v' and w' satisfying the conservation 
of energy condition 

^v'f + {w'f = v'' + w\ 

but otherwise at random, so that {v\w') is randomly sampled from the 
uniform probability measure on the circle 

{{v\w') : iv'f + iw'f = v^ + w^}. 

Kac's n particle gas is thus a Markov jump process on M", for each n. 



In 17 1, Kac proves that this family of n-particle gases propagates 
chaos. Indeed, the exact definition of chaos as the asymptotic independence 
of particles is due to Kac. The notion of chaos originates in Boltzmann 
who derived his equation under a hypothesis of "molecular disorder (chaos)." 

Kac proved that if the particles of each n-particle gas initially have in- 
dependent and /o(t')(iu-distributed velocities, then at a later time t the ve- 
locities of a random pair become increasingly independent as n — > oo, even 
though the initial condition of pure independence or "molecular chaos" has 
been spoiled by collisions. The random velocity of a single particle at time 
t becomes increasingly /(ti, i)-distributed as n — oo, where f{v,t) satisfies 
an analog of Boltzmann's equation, namely, 

—f{v,t) = ~ / / f{vcos0 — wsmO)f{vsm0 + wcos0)d9dw — f{v) 
c't T Jr Jo 

f{v,0) = foiv). 



Indeed, the sequence of n-particle joint distributions at time t is f{v,t)dv- 
chaotic. 

Similar procedures yield particle systems for the spatially homogeneous 
Boltzmann equation [17|. The spatially homogeneous Boltzmann equation 
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for hard spheres of radius r is 

^/(v,t) = G[fiv,t)]-L[fiv,t)] 

.2 



G[f] = / / /(v*,t)/(w*,t)||(w-v).l||(iyw 
^ JR^ JS2 

m = if f /(v,t)/(w,t)||(w-v).l||dyw, 

(2.7) 

where dl is normaUzed surface area on the sphere 52, and 

V* = V + ((w - v) • 1)1 
w* = w — ((w — v) • 1)1. 

(2.8) 

One may devise several n-particle jump processes for the Boltzmann equa- 
tion. Griinbaum suggests one with a three-stage random mechanism for 
making jumps: given that the initial state of the gas or the state it has just 
jumped to is 

(vi, V2, . . . , v„); Vj G M^, 

1) Select two distinct particles at random (equiprobably), say the i*'* and 
jth particles where i < j. 

2) If Vj = Vj select another pair. Otherwise wait for an exponentially 
distributed random time of mean duration ||vj — Vj ||/(n — 1). 

3) Jump to (vi, . . . , v*j, . . . , v*j, . . . , v„) with probability proportional to 
J^^-^qp, where v*j, v*j, and 1 are as in (^). 

II 1 J w 

Note that the jumps speed up as the number of particles increases so that the 
number of jumps per particle per unit time is roughly constant. Griinbaum 
proves that this family of re-particle processes propagates chaos and that the 
limit satisfies (2.7) under certain assumptions |T^. His proof relies on the 



theory of strongly continuous contraction semigroups. 

Other jump processes similar to those of Kac have been treated by several 
authors. Uchiyama [^] proves propagation of chaos and a central limit 
theorem for families of Kac-type processes, on countable sets of velocities. 



Rezakhanlou and Tarver |31] prove an interesting propagation of chaos result 



for the discrete Boltzmann equation in one dimension. Their particles travel 
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with constant velocities around a circle in between random collisions that 
become increasingly local as the number of particles increases. Graham and 
Meleard prove the propagation of chaos for a variant of the Boltzmann 
equation with nonlocal collisions. Particles experience random Kac-type 
collisions, but do not need to be at the same spatial location in order to 
collide. Bird's numerical scheme for Boltzmann's equation Q amounts to 
the simulation of one of the processes studied by Graham and Meleard. 

The jump processes of Kac et alia are intrinsically stochastic, for col- 
lisions happen at random and have random results. On the other hand, 
the dynamics of real molecules are strictly deterministic, or are classically 
conceived to be such. Our idealized model for molecular dynamics, the hard 
sphere model, admits no randomness at all. When two particles collide, 
their outgoing velocities are determined by their incoming velocities and 
their attitude at collision. (It is true that the outcome of a simultaneous 
collision of three or more spheres may not be determined, but in a dilute 
enough hard sphere gas these collisions are so rare that they have negligible 
effect.) Since Boltzmann's equation is supposed to govern the macroscopic 
behavior of the density of a hard sphere gas, it ought to be derivable some- 
how from the deterministic dynamics of hard spheres. But alas, it would 
appear that the Boltzmann equation is not even consistent with molecular 
dynamics, much less derivable from it, for the molecular dynamics are re- 
versible and Boltzmann's equation is irreversible. This apparent antinomy, 
known as Loschmidt's paradox, has been raising deep concerns about the 
validity of Boltzmann's equation for nearly as long as that equation has 
been known. It is therefore surprising and philosophically significant that 
(notwithstanding Loschmidt's paradox) Boltzmann dynamics can indeed be 
derived from molecular dynamics. 



Grad |13] first advanced the idea that Boltzmann's equation may be 



derived in the dilute limit 



nr"^ — > constant 



of hard sphere dynamics, and Lanford [|l^] succeeded in a rigorous deriva- 
tion of Boltzmann's equation along the lines suggested by Grad. Lanford's 
theorem can be neatly expressed in terms of of chaos. This approach can 
be found in The Mathematical Theory of Dilute Gases by Cercignani, Illner, 
and Pulvirenti 01(pp. 90-93), who emphasize that the theorem of Lanford 
constitutes a validation of Boltzmann's equation from the fundamental prin- 
ciples of molecular dynamics. 

Let us describe Lanford's result. 
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Consider the deterministic dynamics of n hard spheres of radius 

The phase space is formed by excising the points of (R^)" that represent 
configurations in which two or more spheres would overlap. The set of all 
initial configurations that lead to simultaneous collisions of three or more 
particles or to infinitely many collisions in finite time has measure zero 
and can be ignored. The trajectories through phase space are determined 
by the free motion of the spheres between collisions and the rule ( |2.lD for 
binary collisions. When a trajectory hits a boundary point of the phase 
space, i.e., when a collision occurs, the trajectory continues from the unique 
boundary point that the rule of elastic collision associates to it. This defines 
the deterministic dynamics of a dilute gas of n hard spheres of radius 
Increasing n increases the number of particles but decreases the density, 
whence the term "dilute limit." 

Lanford's theorem states (roughly) that there exists r > on the order 
of the mean free time such that, if the initial n-particle densities are /o- 
chaotic in a very strong sense , then the densities at a later time t < t are 
ft chaotic, where ft is a mild solution of the Boltzmann equation with initial 
data /q. The hypotheses on the initial data are that the fe-marginals of the 
symmetric n-particle distributions are absolutely continuous with continuous 
densities, and those densities satisfy a growth bound depending on k and 
converge uniformly on compact sets to /^'^ in the dilute limit n — > oo. This 
hypothesis on the initial data is stronger than mere chaos, and Lanford's 
theorem asserts that such strong initial chaos is propagated. The n-particle 
densities at a later time will be chaotic, says Lanford's theorem, but typically 
not chaotic in the same strong sense as were the initial densities. This 
"loss of convergence quality" is what permits the Boltzmann equation to be 
irreversible even though it is derived from reversible dynamics |0, p. 97]. 

Lanford's theorem says that chaos is propagated, but only if the ini- 
tial densities converge uniformly on compact sets, et cetera. This kind of 
propagation of chaos differs from propagation of chaos as defined in this 
dissertation; it has to do with subtler properties of uniform and pointwise 
convergence of densities rather than simple weak convergence of distribu- 
tions. We remark that the hard sphere gases of Grad and Lanford do not 
propagate chaos in our sense, nor do they satisfy the conclusions of our 
theorems about families of Markov processes that propagate chaos. 
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2.2 Plasmas and Stellar Systems 



This section contains an account of the propagation of chaos for the Vlasov 
equation. 

2.2.1 Vlasov's equation 

Vlasov's equation |5|, ^] is another important equation of kinetic theory. 
It governs the density in position-velocity space of particles that interact 
(without colliding) through long-range forces such as the electric forces be- 
tween ions in a plasma or the gravitational attraction between stars in a 
galaxy. 

Suppose, for simplicity, that all particles in the system are of the same 
species, each having mass m, and let -F(x) denote the force that a particle 
at the origin would exert on a particle at x. For example, the force -F(x) 
is proportional to x/||x|p if the particles are electrons, and proportional to 
— m'^x/||x||^ if the particles are stars. If /(x, v, t)(ixdv denotes the number 
of particles per unit volume near (x, v) at time t, we find that the net force 
on a particle at x is 

Ff{x):=[ F(x-x')/(x',v',t)dx'(iv'. (2.9) 

The particle density /(x, v, t) changes through the motion of particles sub- 
ject to the force field -^/(x). 

Vlasov's equation for the density is 

|;/(x,v,t) = -V Vx/(x,v,t) - -Fy(x) • Vv/(x,v,t), (2.10) 
ot m 

where the net force field Ff{x.), defined in equation ( |2.9D , depends on the 
particle density / itself. This is just an advection equation for the flow on 
(x, v)-space given by the time dependent fiux (v,F(x)), with the require- 
ment that F equals Ff, i.e., the flux function at time t is determined through 
( |2.9D by the solution at time t of the advection equation itself. 

The preceding is a heuristic derivation of Vlasov's equation from the 
smoothed dynamics of a large but flxed number of particles. Vlasov's equa- 
tion may be derived rigorously from the true dynamics of interacting particle 
systems, in the limit of inflnite particle number. This rigorous derivation is 
the content of the theorems, stated in the next section, on the propagation 
of chaos for Vlasov and McKean- Vlasov equations. 

Propagation of chaos clarifles the relationship between the Vlasov equa- 
tion and the dynamics of gravitational systems and plasmas. 
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Imagine n particles of mass ^ following the classical n-body evolution. 
As the number of particles tends to infinity and the initial distribution of 
particles approaches a distribution /(x, v, 0)dxdv of mass, Vlasov's equation 
is an increasingly correct description of the evolution of the mass density. 
The mass density follows equation ( 2.1C| ) with m set to 1 and with -F(x) 
redefined as the gravitational force on a test particle of unit mass at x due 
to a particle of unit mass at the origin. 

It is a little tougher to obtain a macroscopic equation for the density of 
charge in the limit of infinitely many ions. A fc-fold increase of the number 
of electrons (say) in a plasma increases the forces by a factor of /c^ and the 
system becomes too energetic in the limit n — > oo. Vlasov dynamics can 
only result from proper scaling of mass and/or time. One possibility is to 
imagine n electrons of mass n each. In the limit n — > oo, the density of 
charge in position- velocity space satisfies equation ( |2.10| ), mutatis mutandis. 
An alternative scaling is found in 0]: Consider the dynamics of n ions of 



mass ^ each. As n-tends to infinity, and time is slowed as ^, < 
Vlasov equation for the density in position-momentum space. 



2.2.2 McKean- Vlasov particle systems 

We begin with a statement of the propagation of chaos for Vlasov's equation. 
It is assumed that the interparticle force is bounded and globally Lipschitz, 
an assumption that excludes the physical inverse-square forces of gravita- 
tional systems and plasmas. One way around this difficulty is to assume 
that the system is so dilute that particles never get too close to one another. 
The interparticle force could then be replaced with one without the singu- 
larity at zero distance that is still inversely proportional to the square of the 
distance between particles when that distance is not too small. 

Let F : — > be bounded and Lipschitz. For each n, define a 
deterministic n-particle process in by the following system of ordinary 
differential equations (ODEs): 

|x?(t) = v»(t) 
d 1 " 

-v?(t) = -E^x?-") 

(2.11) 

for i = 1,2, . . . ,n. Braun and Hepp ||5[ prove that if the initial conditions 

x^(o),v?(o),x5(o),v^(o),... ,x::(o),v;:(o) 



19 



are such that 

1 " 

i=l 

then, for each t > 0, 

1 



n . 



where G P(M") is the weak solution at time t of the Vlasov equation 
^/(x,v,t) = -vVx/(x,v,t)-F/(x)-Vv/(x,v,t) 



Fy(x 



= / F(x - x')/(x', v', t)dx dv 
/Wo = /(x,v,0)dxdv. 

(2.12) 



Thanks to our Corollary 4.2, this theorem of Braun and Hepp implies 
that the family of n-particle processes (|2.11 ) propagates chaos. The fact 
that the result of Braun and Hepp implies the propagation of chaos is also 
noted in p. 99]. 

The deterministic particle systems ( |2.11| ) may be generalized to interact- 
ing diffusions. A diffusion is a Markov process with continuous trajectories, 
like the solution of a stochastic differential equation. McKean |22| initiated 
the study of propagation of chaos for diffusions and what is now called the 
McKean- Vlasov equation. 

Let V : M*^ X M"^ — ^ and a : x M*^ — > R he bounded and 
globally Lipschitz. For each n, consider the system of n stochastic differential 
equations (SDEs) 

=^7^p^ X;) I + I ^ E ^{Xr,X^) I dW„ (2.13) 

for random vectors X^, X2, • • • , in M'^. The Wiener processes 

Wi, W2, Ws, ... 

are taken to be independent of one another and of the random initial con- 
ditions 

xno), x^io), x^io). 
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Each system of SDEs has a unique solution and defines a Markov transition 
function 



Kn{^,dy,t) : {R'^r x x [0,oo) [0,1] 

by 

' </.(y)K„(x,dy,t) ■.= K^[<P{Xnt),... 



/ 



In other words, for fixed t >0 and x € (M'^)", Kn{'K, is the distribution 
of the position at time t of random trajectory 

X^^{Xnt),X^{t),... ,X^(t))G [c([0,oo),M' 

that started at X"(0) = x. 



McKean [21, |2^ proves that if the particles are initially stochastically 
independent but with a common distribution fiQ, then the sequence of n- 
particle joint distributions at time t is ^t-chaotic, fit being the (weak) solu- 
tion at time t of the nonlinear McKean- Vlasov equation 

|/i(x) = -V.[yHx)/*(x)] + ^A[Z);(x)/i(x)] 



y/(x) = / v(x,x')/i(xOdx' 
I?/(x) = ([ a(x,x')/t(x')rfx' 



2 



/o(x)dx = ^0- 



(2.14) 



McKean's result includes that of Braun and Hepp: when cr = there 
is no diffusion and the system of SDEs ( p.l3| ) becomes a Vlasov system of 
ODEs hke (|2lll ). Braun and Hepp seem unaware, in their paper of 1977, 



of McKean's important work of 1966. They use a different method to prove 
the propagation of chaos for Vlasov systems. Though they only treat the 
deterministic (Vlasov) case, their method can be generalized to prove that 
interacting (McKean- Vlasov) diffusions also propagate chaos. 

McKean really proves much more than the propagation of chaos. Sup- 
pose the initial positions X"(0),... ,X^{0) for the n-particle systems are 
taken to be the first n terms of a sequence Zi, Z2, Z^, . . . of independent 
and /io distributed random variables. McKean proves that (t), the ran- 
dom position of the i*'* particle at time t, converges in mean square to X^{t) 
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as n tends to infinity. The X?° are independent and identically distributed. 
(t) is sometimes called the nonlinear process and it satisfies the SDE 

dX = [f Y{X,y)fit{dy)]dt+{ f a{X,y)fit{dy)]dWi 
jjit = Law(X(t)) 

with X{0) = Zi. 
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Chapter 3 

Chaos and Weak 
Convergence 



Chaos of a sequence of symmetric measures is equivalent to weak convergence 
of certain probability measures. This observation, due to Sznitman and 



Tanaka, is the subject of this chapter. First, in Section 3.1, the theory 
of weak convergence of probability measures is reviewed. The theorem of 
Sznitman and Tanaka is proved in Section We examine this equivalence 
in the simplest context of finite probability spaces in Section I 



This chapter ends with Theorem 3.5: on a finite space, chaos implies 



convergence of specific entropy to the entropy of the single-particle distri- 
bution. 



3.1 B ackground 

Let X be a set and T a class of subsets of X that contains the empty set 
and is closed under complementation and countable unions. (X, is called 
a measurable space, and the sets in T are called measurable. A probability 
measure or law on {X, T) is a countably additive, nonnegative function 

P:T — > [0, 1] 

satisfying P{X) = 1. The measure P{F) of a set F ^ \s the probability of 
F. Countable additivity requires the probability of a union of a sequence of 
disjoint measurable sets to equal the sum of their probabilities. The simplest 
probability measure is a point mass at a point x £ X, denoted 6(x) or dx] 
Sx{F) equals one if x € -F, otherwise it equals zero. 
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Let {X,J^) and (Y^Q) be measurable spaces, and let h : X — > Y be 
measurable, i.e., h~^(G) E J- whenever G G Q, where h~^{G) is the inverse 
image of G under h. Any probabihty measure P on X induces a probabihty 
measure Poh~^ onY via h. The probabihty measure induced by h is defined 
for G G g by 

{Poh~'){G) ■.= P{h-\G)). 
This definition imphes that for any integrable function cj) on (Y, Q, P o h^^), 

[ ^{y)Poh~\dy)= [ ^{h{x))P{dx). 

Now let (X, T) be a Hausdorff topological space with topology T. The 
Borel a-algebra, B, is the smallest a-algebra containing T. The Borel algebra 
is thus the smallest a-algebra with respect to which any function continu- 
ous on (X, T) is measurable. The set of probability measures on (X, B) is 
denoted V{X). 

We often call probability measures simply "laws." 

Let Gh{X) denote the continuous and bounded real- valued functions on 
(X, T). The set of laws 'P{X) is endowed with the weakest topology render- 
ing continuous the maps 

P G V{X) I — > [ g{x)P{dx) e M, 
Jx 

for all g G Ch{X). This is known as the weak topology on V{X). A net of 
laws {Pjs} in V{X) converges to P in the weak topology if and only if the 
nets {/ gPp] converge to J gP for all g G Cb{X). 

We consider exclusively the case that X is homeomorphic to a separable 
metric space {S,ds), so that we may use certain results of the theory of 
weak convergence. The theory of weak convergence of laws is customarily 
expounded for laws on separable metric spaces, and especially complete and 
separable metric spaces, because of the influence of Prohorov's original study 
[ p8[ of 1956. Around the same time, Le Cam developed the theory of of 
weak convergence of laws on completely regular topological spaces. 

For separable metric spaces {S, ds), the weak topology on V{S) is metriz- 
able. Two metrics on 7^(5') that generate the weak topology are the Levy- 
Prohorov distance LP and Dudley's distance BL*. The Dudley distance 
between two laws fj-,i^ £ is 

BL*(n, u) := sup 

geBLi 
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g{s)n{ds) 



g{s)v{ds] 



where g ranges over the class BLi of bounded Lipschitz functions from S to 
R defined as 

BLi:= \g{s) : sup {\g{s)\}+ sup {\g{s) - g{t)\/ds{s,t)} < 1 

The Levy-Prohorov distance between /U and v is 

LP(/u, u) := inf jj > : iy{B) < niB"'^) + 6 for ah closed sets s| , 

where B~^^ is the set of all points in S that are within 6 of some point of B: 

B+^ ■={seS: dsis,B) < 5}. 

These metrics are discussed in Chapter 11 of the textbook Real Analysis 
and Probability, by Dudley | p^ . 

The general theory of weak convergence in law on Polish spaces is due to 
Prohorov. (A topological space is Polish if it is homeomorphic to a complete, 
separable metric space.) Prohorov's theorem characterizes compact sets in 
'P{X) when X is Polish, much as the Arzela-Ascoli theorem characterizes 
compactness in the space of continuous functions on a compact Hausdorff 
space. The Arzela-Ascoli theorem states that a family of functions on a 
compact space is relatively compact (has compact closure) in the topology of 
uniform convergence if and only if the family is equicontinuous and bounded. 
Prohorov's theorem states that a family of laws on a Polish space is relatively 
compact if and only if it is tight. 

Tightness is a simple condition: 

Definition 3.1 Let S C V{X) be a family of laws on a topological space. 

The family S is tight if for each e > there exists a compact C X 
such that 

sup{fi{X\K,)} <e. 

Tightness implies relative compactness, and the conditions are equivalent in 
separable, topologically complete spaces: 

Theorem 3.1 (Prohorov) Suppose {X,T) is homeomorphic to a separa- 
ble metric space. Then, if H C 'P{X) is tight, its closure is compact in 
V{X). 

If{X,T) is Polish (homeomorphic to a complete, separable metric space) 
then S C V{X) is tight if and only if its closure is compact in V{X). 
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It follows from Prohorov's theorem that V{X) is Polish if X is Polish 
[10|. This is important to us since the proof of our main theorem requires 
the application of Prohorov's theorem to V{X). 

Convergence of Probability Measures by Patrick Billingsley Q is a charm- 
ing classic monograph on the theory of weak convergence of laws and its 
applications. Unfortunately, this text is missing some essential material, es- 
pecially the metric approach to weak convergence. It is well complemented 
by the material in [p!0|]. 



3.2 The Theorem of Sznitman and Tanaka 

Let (5, ds)hea separable metric space with Borel algebra Bs- Let 5" denote 
the n-fold product of S with itself; 

5" := {(si,S2, . . . ,s„) : Sj G S* for z = 1, 2, . . . , n} . 

S'^ is itself metrizable in a variety of equivalent ways that all generate the 
same topology and the same Borel algebra Bs" . 

The marginal of a law pn E (5'") on the first /^-coordinates (A; < n) is 
the law p^n^ € V{S^) induced by the projection 

(Sl, S2, . . . , Sn) I > (Sl, S2, • • • , Sfc)- 

Equivalently, 

Pn\Bi,B2, ... , Bk) = Pn{Bi,B2, ... , Bk, S,S,... , S), 

for all Bi,B2,... ,Bk e Bs- If p G V{S), the product law G ^(5") is 
the law p{dsi)p{ds2) ■ ■ ■ p{dsn). Note that = p®^ . 

Let Yin denote the set of permutations of {1, 2, . . . , n}. The permutations 
n„ act on S*" by permuting coordinates: the map vr- : — > 5" is 

TT • (Sl, S2, . . . , S„) := (5,^(1), 5,^(2), • • • , S^(n))- 

If E is any subset of S", define 

TT • = {vr • s : s G E}. 

A law p on 5" is symmetric if p{tt-B) = p{B) for all vr G n„ and all B G ^S"- 
Products /O*^" are symmetric, for example. The symmetrization p of a law 
p G V{S'^) is the symmetric law such that 

vren„ 

for all B G S^n. 
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Definition 3.2 (Kac, 1954) Let (S, ds) be a separable metric space. Let 
p be a law on S, and for n = 1,2, . . . , let pn be a symmetric law on S*". 

The sequence {pn} is /O-chaotic if, for each natural number k and each 
choice 

Ms), Ms), ■■■ , 4>k{s) 

of k bounded and continuous functions on S, 

k 

lim / (I)i{si)4>2{s2) ■ ■ ■ (t)k(.Sk)pn{dsids2 . ■ -dsn) =Y\ 4>i(.s)p{ds). 
Js" f^i Js 

(3.1) 



In case S is Polish, condition implies the weak convergence of the 
marginals to products p^^, because the class of functions of the form 

<Pi{xi)(p2{x2) ■ ■ ■ (pkixk); (^1, . . . G Cfe(5) (3.2) 



is a convergence determining class for V{S )^^. Condition ( |3.lD shows that 
the sequence of the marginals pn^ converges to p'^'^ weakly for functions of 
the form 3.2 , hence it converges weakly. Thus, if S is Polish, a sequence 
{pn} of symmetric laws on 5" is />-chaotic if and only if 

lim pi'^) = 

n— >oo 

for any natural number k. 

It turns out, however, that S does not need to be Polish. It will be 
seen from the proof of the next theorem that condition (3.1) implies the 

(k) 

convergence of the marginals pii even if S is not Polish, but only separable. 

The following theorem of Sznitman and Tanaka states that a sequence 
of symmetric laws is chaotic if and only if the induced sequence of laws of 
the random empirical measures converges to a point mass. Let 



1 " 

£n{{si,S2, ... , Sn)) ■= - y^6{Si) (3.3) 



n . 



define a map from 5" to V{S). These maps are measurable for each n, and 
en('/r • s) = en(s) for all s € S"", vr € Yin- 

Theorem 3.2 (Sznitman, Tanaka) {pn} is p-chaotic if and only if 

Pn o e-' 6{p) (3.4) 

in V{V{S)). 
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Proof: 

Suppose {pn} is p-chaotic. 

A sequence of laws {fJ-n} on a completely regular topological space X 
converges to 6{x) € Vi^X) if and only if for each neighborhood N x 



lim \N)=0 



(3.5) 



for each neighborhood of x. Therefore, to prove the convergence of pnO£n^ 
to 5{p) in V(V{S)) it suffices to verify ( p. 51 ) on a subbase of neighborhoods 
of /9 E V{S). The class of sets of the form 



1^ G ViS) : 



g{s)u{ds) - / g{s)p{ds] 
s Js 



<e ; e>0,geCbiS) 



is a neighborhood subbase at 5{p), so it suffices to show that 



g{s)u{ds) - I g{s)p{ds) 
s Js 



Writing g{s)v{ds) as < g,^ >, we calculate 
/ \< g,en{s) > - < g,p>\^ pn{ds) 

= / ( - y^5(si)- < 5,P > I Pn{dsids2 ■ ■ ■ dsn) 

1 " /■ 

= — y] / {9{si)- < 9,P>){g{sj)- < g,P>) pn{ds) 

= - / (5(s)-<9,P>)'pi')(ds) 
Js 

+- / {a{si)- < g,p>){g{s2)- < g,p>) p'i\dsids2), 



(3.6) 



n Jsxs 



the last equality by the symmetry of pn- Thus condition ( p.l| ) for k = 1,2 
implies that 



/ |< 5,en(s) > - < 5,P >lVn(c^s) 



0, 



and hence that ( |3.6| ) holds. Condition ( |3.1D thus implies condition (3.4). 
Now suppose that p„ o tends to 6{p). 
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For natural numbers k < n, let Jn-k and Zn-.k denote respectively the 
set of all maps and the set of injections from {1, 2, . . . ,k} into {1, 2, . . . , n}. 
Define the map e^ifc from S"' to V{S^) by 



en:fc((si,S2,--- , s„)) := 



{n-k)\ 



(3.7) 



£n:k{^) is the empirical measure of /c-tuples of coordinates of s, sampled 
without replacement. Define also 



).■■■ ,J>j(fc) 



fc)) ' 



(3.8) 



the empirical measure of all A;-tuples from s. When n >> k, these two em- 
pirical measures are close in total variation (TV) and a fortiori in Dudley's 
distance on V{S): 



BL* {er,.k(s),eJsr'' 



< 



{n-ky. 



n 



l)v,Sj(fc)J 



< 2 1 



n! 



TV 



Since this bound is uniform in s, it follows that o e^.^ is near pn o -i?^.^ 
in V{V{S^)). In fact, both the Levy-Prohorov and the Dudley distances 
between the two laws are bounded above: 



and 



n^{n — k)\ 



(3.9) 



Condition ( |3.4D and definition ( |3.8| ) imply that p„ o -i?^.^ converges to 
(5(p®^) in V{V{S'')). By (p|), /)„ o converges to (5(p®'=) as weU. 
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Now, ii^eCbiS''), 

lim / (j){si,S2,. ■ ■ ,Sk)pn{ds) 

= lim [ J . . . I p„((is) 

n^ooJg„ n! 

= lim / < (j),en;kis) > p„{ds) 



IS" 

lim / < 0, /X > p„ o e_i(^^^) 
lim / < 0, /X > p„ o ■dZ.Xidij) 



IV{S'=) 
Vis'') 

si,S2, . . . ,Sfc)p((isi) • ■■p{dsk). 



Thus, condition ( ^ ) implies {^^). ■ 

The preceding arguments have actually proved the following stronger 



version of Theorem 3.2. 



Theorem 3.3 Let S be a separable metric space and for each n let pn be a 
symmetric law on S^. 

The following are equivalent: 

Kac's condition for k = 2: For all 0i,(/)2 ^ Cb{S), 



lim / 0i(si)(/>2(s2)/>n(ds) = / (j)i{s)p{ds) / (j)2{s)p{ds); (3.10) 

Js Js 



Condition of Sznitman and Tanaka; For all natural numbers k, the 
laws Pn o converge to 6{p^^) in V{'P{S)) as n tends to infinity, where 
£n:k is the empirical measure defined in ^. Ij ) ; 

Ik) 

Weak convergence of marginals; For all k, the marginals pn converge 
weakly to p®^ as n tends to infinity. 
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3.3 Chaos on Finite Sets 

Throughout this section, let S = {si, S2, ■ ■ ■ , Sfc} be a finite set. 
For each natural number n, let 

be a symmetric law on S'^ = SxSx---xS. Because of its symmetry, p^, 
is entirely determined by the probability function 



-Pn(jl,j2, • • • ,Jfc); ^^-^^^ 



i=l 



that gives the probability there are ji coordinates equal to si, j2 coordinates 
equal to S2, and so on. The probability of {xi,X2, ■ ■ ■ , x„) € 5" is 

P„(X1,X2, . . . = P„(jl,j2, • • • ,Jfc)/— j — T , (3.12) 

where X2, . . . , Xn) is the number of coordinates of {xi,X2, ■ ■ ■ , Xn) that 
equal Sj. 

Let Afc_i denote the unit simplex in M'^: 

Afc-i = |(Qi,g2, . . . ,gfc) : = l,gi > o| . 

Given pn, define a law pn on Afc„i by 

^„ :=^P„(j),5(j/n) , (3.13) 



where j ranges over fc-tuples of nonnegative integers that sum to n. 

Finally, let p = {pi,P2,--- ,Pk) be a point of Afc_i, and let p denote 
the law on S given by p{si) = pi. With these definitions and notations, we 
can formulate simpler versions of Definition 3.2 and Theorem 3.2 for finite 
probability spaces: 

Definition 3.3 (Chaos for Finite State Spaces) The sequence {pn} is 
p-chaotic if for each natural number m and each {zi,Z2, ■ ■ ■ , Zm) in , 

m 

lim Pn{zi,Z2,... ,Zra,Xi,X2,... ,Xn-m) =T\p{zi). 

n—>oo ^— ' 
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Theorem 3.4 The sequence {pn} is p-chaotic if and only if Hn converges 
weakly to 5{p). 

Equivalently, {pn} is p-chaotic if and only if 



Um y 

n—*oo ' 

(iiv Jk) 



Jl J2 

n n 



3_k_ 

n 



(3.14) 



for every continuous function F on the simplex A^. 
Proof: 



This is a special case of Theorem 3.2 



Formula ( 3.14 ) will be used to prove that, on finite probability spaces, 
chaos implies convergence of specific entropy. We are borrowing the expres- 
sion "specific entropy" from statistical mechanics, where it refers to entropy 
per particle. 

For laws vr and /x on a measurable space {X, T), the entropy of /i relative 
to vr is defined to be 



X 



dp 
dn 



log 



dp 
dn 



dir 



and to equal 



if p is absolutely continuous relative to vr with density 
— oo otherwise. 

Relative entropy is nonpositive, but might equal —oo. Ht^{p) achieves 
its maximum of only when p = tt. If X is a Polish space, Htj{p) is a upper 
semicontinuous function of p relative to the weak topology on P(X). The 
entropy of a joint law is less than or equal to the sum of the entropies of its 
marginals, with equality only if the joint law is a product measure. That is, 
if E V{X X X) with marginals pi,p2 G 'PiX)., then 



-f^7r(g)7r(/^) < Ht,{pi) + H^{p2) 



(3.15) 
pp. 32-40] for 



for any reference law vr G V{X). The reader is referred to 
properties of the relative entropy. 

Now, if vr is a reference law and {pn} is a p-chaotic sequence of laws 
on a general separable metric space (where chaos has been defined), the 
subadditivity ( 3.15 ) of entropy guarantees that 



lim sup —H^a 

n— >oo 'n 



'(/On) < Ht,{p). 



The left hand side of this inequality is what we are calling the specific 
entropy. In case {pn} is purely chaotic, i.e., in case pn = p®"" for all n, 
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the specific entropy always equals the entropy of p. At the other extreme, 
when the symmetric laws of a p-chaotic sequence {pn} are not absolutely 
continuous relative to the laws p®", the above inequality is strict, for then 

lim —H^isnipn) = — oo < = HJp). 

n^oo n 

However, if the space is finite, one can prove that the specific entropy of a 
chaotic sequence does converge: 

Theorem 3.5 (Specific Entropy Converges) Let S = {si,S2,--- ,Sk} 
be a finite set, and for each n let pn € V{S^) he a symmetric law. 
If the sequence {pn\ is p-chaotic, then 

lim (-- Y] /0n(x)log/9n(x) I =-V'pilogPi. 
\ X65" / 1=1 

Proof: 

By the relationship ( 3.12| ) between pn and P„, 

^ ^ /j„(x)log/Jn(x) = ^ P„(ji,... ,jfc)log " '-^^^ 



xe5" {ji,-,h) 
This equals 

-- 5^ P„(j) log P„(j) + ^Y1 ^"(j) (-T^) ' (3.16) 
J J 

abbreviating (ji,j2,... ,jfc) by j. The first addend in ( |3.16D is O (^^^^^, 

since it equals an n^^ part of the entropy of a probability function Pn(j) on 
fewer than points, which entropy cannot exceed log(n'^) = A;logn. 
Using Stirling's approximation 

logj! =ilogi-i + ej 

where < < 1 + log j , and the fact that n = Yli=i Jn finds that 

n! ^ ^ 

log 



Ji! • • - Jfc 



yj = nlogn - n + e„ - ^(jjlogji - ji) - 

i=l i=l 

= n log n - ^ ji log ii + O (log n) 

i=l 

= - ji log - + O (log ^ 



n 

i=l 
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Substituting this into the second term of ( 3.16 ) shows that 

k 



— 11 Pn{^) log /^n(x) = - E ^'^(j) E ( f ) ( f ) + O 



xe5" 



4 = 1 



logn 



n 



(3.17) 



Since pn is /o-chaotic, formula ( |3.14| ) of Theorem 3^ tells us that 



lim < 

n— ►oo 



^PilogPi. (3.18) 



By ( 3.17 ) and (|3.18D the specific entropy converges to the entropy of p: 
lim (-- p„(x)logp„(x) I = - S^ pilogpi. ■ 

n— >oo \ n ^ — ' / ^ — ' 

\ xe5" / i=l 
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Chapter 4 

Propagation of Chaos 



This brief chapter is devoted to the proof of the main theorem stated in 
Section f]^. Definitions are given and the approach is outhned in Section 



4.1. Lemmas are proved in Section 4.2 that expedite the proofs of the 



theorems of Section 



4.1 Preliminaries 

Let (X, and {Y, Q) be two measurable spaces. A Markov transition func- 
tion K{x^ E) on X'xQ \s a, function that satisfies the following two conditions: 

(1) K{x^-) \s a. probability measure on (y, Q) for each x G X, and 

(2) K(-,E) is a measurable function on {X,T) for each E £ Q. 
Whenever X and Y are measurable spaces and there is no confusion 

about what their cr-algebras are supposed to be, we usually speak of Markov 
transitions from X to y rather than transition functions. In particular, if 
S and T are metric spaces, a Markov transition from to T is a transition 
function on x Bt- 

A Markov process on a state space {X, J^) determines a family, indexed 
by time, of Markov transitions from X to itself: {K[x, E, t)}t>o- The transi- 
tions satisfy — in addition to (1) and (2) above — the Chapman-Kolmogorov 
equations 

K{x,E,s + t)= K{x,dy,s)K{y,E,t); s,t > 0, x £ X, E e J". 
Jx 

Let {S, ds) and (T, dx) be separable metric spaces. For each n, let Kn be 
a Markov transition from 5" to T". We assume that the Markov transition 
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function is symmetric in the sense that, if tt is a permutation in n„ and 
A is a Borel subset of T", 

Kn{7T-S,7:-A) = Kn{s,A). (4.1) 

Definition 4.1 (Propagation of Chaos) Let {K^} be as above. 

The sequence {K^} propagates chaos if, whenever {pn} is a p-chaotic 
sequence of measures on S", the measures 

on T'^ are t -chaotic for some r G V{T). 

When wc say that a family of n-particle Markov processes on a state 
space S propagates chaos we mean that, for each fixed time f > 0, the 
family of associated n-particle transition functions {Kn{s,E,t)} propagates 
chaos. 

Most Markov processes of interest arc characterized by their laws on 
nice path spaces, such as C([0,oo),S') the space of continuous paths in S, 
or the space -D([0, co), 5) of right continuous paths in S having left limits. 
For such processes, the function that maps a state s G to the law of 
the process started at s defines a Markov transition from S to the entire 
path space. Now, if a sequence of transitions Kn{s, ■) from 5" to the path 
spaces C([0, oo), S") or Z)([0, oo), S") propagates chaos, then, a fortiori, it 
propagates chaotic sequences of initial laws to chaotic sequences of laws on 
5" at any (fixed) later time. We have defined the propagation of chaos for 
sequences of Markov transitions from S"^ to a (possibly) different space T", 
instead of simply from 5" to itself, with the case where T is path space 
especially in mind. This way, our ensuing study will pertain even to those 
families of processes that propagate the chaos of initial laws to the chaos of 
laws on the whole path space. 

We are going to prove that a sequence of Markov transitions {-^nj^i 
propagates chaos if and only if 

is chaotic whenever s„ G S'" satisfy en(s„) — y p in V{S). We employ the 
weak convergence characterization of chaos of Sznitman and Tanaka and we 
assume that S is Polish. To study the propagation of chaos, we project the 
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transitions Kn from 5" to T" onto transitions from £n{S^) to 'P(T), and 



then apply Theorem 3^, which projects chaotic sequences of symmetric laws 
on the spaces onto convergent sequences of laws on V{S). 

^From now on, the notation e„ is used both for the map from to 
n-point empirical measures on S and for the same kind of map on T". 

Markov transitions Kn from 5"" to T" induce Markov transition functions 
Hn from to £„(T"). The induced transition function can be defined 

in terms of a Markov transition J„ from e„(S'") to S*" which acts as a kind of 
inverse of e„. For fixed C G £n{S^), let JniC, •) denote the atomic probability 
measure on that allots equal probability to each of the points in £~^({C})) 
a set containing at most n! points. Putting it another way, Jn{C,E) equals 
the proportion of points s G S"" such that = C that lie in E C S^. A 

Markov transition from to induces a Markov transition Hn from 
en(S") to e„(r") defined by 

Hn{C,G):= f Jn{C,ds)Kn{s,e~\G)) (4.2) 

for ( G £n{S"') and G a measurable subset of £n{T"'). Note that if s € 5", 

F„(e„(s),-) =i^n(s,-)°£;\ (4.3) 

where the maps e„ written on the left and right hand sides are, respectively, 
the maps from and to empirical measures in V{S) and V{T). 



Theorem 3.2 shows that propagation of chaos by a sequence Kn is equiv- 



alent to the following condition on the induced transitions Hn- 

Proposition 4.1 The sequence of Markov transitions {Kn}'^=i propagates 
chaos if and only if, whenever {^n £ 'P{£n{S^))}^^i converges in V{V{S)) 
to 5{p), the sequence 



'en(S") 



HniC,-)f^nidC)} (4.4) 



n=l 



converges in V{V{T)) to 5{q), for some q G V{T). 
Proof: 

{//n € P(e„(5"'))} converges to 5{p) if and only if 



/ J„(C,-)/in(dC) 



n=l 
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is chaotic. Therefore, the sequence of transitions {Kn} propagates chaos if 
and only if 



/ ^n(s, •) / Jn{C,ds)fi, 



m (4.5) 



n=l 



is chaotic whenever fin — > ^{p)- 

Now, using definition ([4. 21) of the transitions Hn, we find 



( / Kn{s,-) Jn{C,ds)Hn{dC)] O 

\JS" Jsn{S") J 

/ (/ Jn{C,ds)Kn{s,-) OEn^) fln{dC) 



^n(C,-)/in(dC)- 



Thus, by Theorem 3.2, the sequence ( [1.5| ) is chaotic if and only if the 
sequence ( |4.4D converges to a point mass in V(V{T)). Therefore, {Kn} 
propagates chaos if and only if (0) converges to 5{q), for some q G V{T). 



Proposition 4.1 implies that if a sequence of Markov transitions {Kn} 
propagates chaos, then the sequence {Hn{Cn, •)} converges to a point mass 
whenever G en{S'")} converges in V{S). That this condition implies 
propagation of chaos (and is not just a necessary condition) is equivalent to 
our main theorem. To prove the sufficiency of the condition, we use Lemma 



4.3 of the next section. 



The lemmas of Section 4.2 are presented in a general context. In Section 
4.3 we apply these lemmas to propagation of chaos. In that context the 
induced transitions Hn, thought of as functions from e„(5"') to V{V{T)), 
behave like the maps fn of the lemmas. 

4.2 Lemmas 

Let {X,dx) be a metric space, and Di C D2 C • • • an increasing chain of 
Borel subsets of X whose union is dense in X. For each natural number n, 
let fn be a measurable real- valued function on Dn- 

Consider the following four conditions on the sequence {fn}^=i- They 
are listed in order of decreasing strength. 
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[A] Whenever {fin} is a weakly convergent sequence of probabihty mea- 
sures on X with fin supported on then the sequence 



fnix)finidx) 
X ) n=l 

of real numbers converges as well. 

[B] Whenever {fin} is a sequence of probability measures on X that 
converges weakly to 6{x) for some x £ X, and fin is supported on then 
the sequence { /„(x)^„(dx)} also converges. 

[C] Whenever {dn} is a convergent sequence of points in X, with dn € 
Dn, then {fn{dn)} also converges. 

[D] For any compact K C X, and for any e > 0, there exists a natural 
number such that, whenever m > n > N and d € Dn H then 

\fM - Ud)\ < e. 



Lemma 4.1 [A] ^ [B] =^ [C] [D]. 
Proof: 

Clearly [A] [B]. Setting fin = 6{dn) in [B] shows that [B] =^ [C]. 

To show that [C] =^ [D] , suppose that [C] holds but that [D] fails to hold 
for some compact K C X and some e > 0. Then there exists an e > 0, two 
increasing sequences of natural numbers {n{k)} and {m{k)} with 

n{k + 1) > m{k) > n{k) 

for all k, and a sequence of points dk € H K, such that 

\fm{k){dk) - fn{k){dk)\ > e- (4.6) 

Since K is compact, there exists an increasing sequence of natural numbers 
{k{j)} such that {dk{j)}'jLi converges. Now define the convergent sequence 
{ei G £'„(fc(i))}gi by = when n{k{j)) < i < n{k{j + 1)). By [C], 

the sequence {fi{ei)} converges. But {fi{ei)} does not converge along the 
subsequence indexed by 

n{k{l)), m{k{l)), n{k{2)), m{k{2)),... 

because of ( [4.6[ ) and the fact that 

^n(k(j)) = eni{k{j)) = dk{j)- 

This contradiction shows that [C] must imply [D]. ■ 
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Lemma 4.2 // condition [C] holds, then whenever {d„ G D„} converges to 
X & X, the limit of {fn{dn)} depends only on x. The function of x which 
may thus he defined as 

f{x) := lim fn{dn) 

n^oo 

when dn — > x, is continuous. 
Proof: 

Assume that condition [C] holds. 

Suppose {dn G Dn} and {e^ G Dn} are two sequences that both con- 
verge to X e X. Then the sequence c?i, 62, da, 64, ^5, ee, . • • also converges 
to X, and its n^^ term is a member of Z?„. By condition [C], the se- 
quence /i(c^i), 72(62), 73(^3), .. . converges. This shows that lim/„(c?„) = 
lim/„(e„). 

Suppose Xk — > X in X. Given e > 0, it is possible to find an increasing 
sequence {n{k)} of natural numbers and a sequence of points {e„(j;.) G ^n(A;)} 
such that dx(e„(fe),Xfc) < ^ while |/„(fc)(e„(fc)) - f{xk)\ < e. Then {en(k)} 
converges to x just as {a;^} does, so linik^^ fn{k){(^n{k)) = fi^)- Now 

\f{Xk) - fix)\ < \f{Xk) - fn(k){en{k))\ + \fn(k){en(k)) " fix)\. 

Since the last term tends to zero, 

limsup|/(xjk) - f{x)\ < e. 

fe— »oo 

Since e may be arbitrarily small, f{xk) — > f{x), which shows that / is 
continuous. ■ 

Lemma 4.3 // {X,dx) is a complete and separable metric space, and the 
functions fn are hounded uniformly in n, then conditions [A], [B], and [CJ 
are all equivalent. 

Proof: 

It remains to show that [C] ^ [A] when {X,dx) is complete and sepa- 
rable, and sup^g£)^{|/„(cZ)|} < B for all n. 

Suppose that {fin} converges to G V{X), where fin{X\Dn) = 0. Since 
X is complete and separable, Prohorov's theorem implies that {jin} is tight. 
Thus, given e > 0, there exists a compact C X such that \ Kg) < e 
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for all n. With / : X — > M as defined in Lemma 4.2 



fn{x)fin{dx) - / f{x)n{dx) 

X Jx 



< 



fn{x) - f{x)Hn{dx) 



+ 2Be 



f{x)nnidx) - / f{x)fi{dx) 
Jx 



Condition [C] implies condition [D], a sort of uniform convergence on com- 
pact sets that entails that 



lim / |/n(x) - f{x)\fin{dx) = 0. 



Therefore, 



fn{x)fln{dx) - / f{x)fi{dx) 

X Jx 



lim sup 

n— >oo 

Since e is arbitrarily small, it follows that 



< 2B€. 



fnix)fJ.nidx) 



X 



f{x)n{dx). 



X 



4.3 Theorems 

Let S and T be separable metric spaces. For each natural number n, let 
Kn be a Markov transition from to T" that satisfies the permutation 
condition ([4.1|). Let Hn be the transition from e„(S""') to V{T) that is 
induced by K^, as defined in (4.2). 



Theorem 4.1 If a sequence of Markov transitions {Kn} propagates chaos, 
then there exists a continuous function 

F : V{S) — > V{T) 

such that, if en{sn) — > p in V{S) with s„ G 5", then 

is F(p) -chaotic. 
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Proof: 



The arguments of Lemma 4.1 and Lemma |4.2| will be adapted to prove 



this. 

Take 'P{S) with one of the metrics for the weak topology to be the 
metric space {X,dx) of those lemmas, and take en{S^) to be -D„. For 
each bounded and continuous function (j) € Cb{V(T)) define the functions 
^„ ^Mby 



(4.7) 



V{T) 



where Hn is as defined in (^]^) . These functions 0„ will play the role of the 
functions of the lemmas. 

By hypothesis, {Kn} propagates chaos. Proposition |4.1| therefore implies 
that whenever G V{en[S^))}'^^i converges in V{V{S)) to 5{p), then 



£n(S") 



(pniOfJ-nidC) > 4>{q) 



(4.8) 



for some q G T'{T). In fact. Proposition [4.1| implies that q does not depend 
on our choice of (/): the same q works for all (f) in ([4.g|). 

Condition ([4.8| ) resembles condition [B] of Lemma |4.1| . Lemma 4.1 and 
Lemma can now be applied to show that there exists a continuous func- 
tion G(j,{p), depending on cj), such that if {s„ E S"} is a sequence satisfying 
en(sn) — ^ P in ViS), then 

By ( |4.8| ), G(j,{p) = <j){q) for some q G V{T) that does not depend on (j). The 
only way that all the G^'s can have this form and yet all be continuous is 
for the dependence of g on p to be continuous: there must be a continuous 
F from V{S) to V{T) such that G^{p) = (t){F{p)) for all (j) G Ci,{V{T)). 
Thus, there exists a continuous function F from V{S) to V{T) such that 



0n(en(s„)) HF{p)) 



for all (f) E Cb{V{T)). This fact, and the definitions (^) and (|4^ of 
and (/), imply that 



P] 



6iFip)) 
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Finally, by Theorem 3.2, we have that 



[e„(s„) — >p] => |k„(s„,-)| is chaotic. ■ 

J n=l 

When {S, ds) is complete and separable, the necessary condition of The- 
orem |4.1| is also sufficient. 



Theorem 4.2 (Main Theorem) Suppose {S, ds) is a complete, separable 
metric space. Then {Kn} propagates chaos if and only if there exists a 
continuous function 

F : V{S) — > V{T) 
such that, whenever en(sn) — * P in 'P{S) with s„ G S*", then 

J n=l 

is F{p)-chaotic. 
Proof: 

We have just demonstrated that the condition is necessary (Theorem 



4.1). Next we demonstrate its sufficiency: 

Suppose Pn € V{S^) is p-chaotic. Let fin = Pn ° £n^- Then /i„ — > 5{p) 
in V{V{S)) by Theorem Our goal is to prove that 

Hn{C,drf)fXn{dC) ^ 5{F{p)), 

V(S) 



where Hn is as defined in ([4.2|). This is enough, by Proposition 4.1, to 
demonstrate that chaos propagates. 

By hypothesis, if {s^ € S""} is such that en(sn) converges to p then 
{Kn{sn-, ■)} is -F(p)-chaotic. By Theorem ^]2| and the fact that 

Kni^n, ■) o = -f^n(en(Sn), 

the hypothesis is equivalent to the statement that, if Pn £ £n{S^) foi" each 
n, then 

bn ^P] ^ [HniPn, •) ^ S{F{p))] . (4.9) 

Let <p G C},{V{T)) be a bounded and continuous function on V{T), and 
define functions i;^^ : £niS^) — > M by 

MO ■■= [ mHniCdri). (4.10) 
Jr{T) 
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These functions are uniformly bounded in n since (f) is bounded. 
The hypothesis ([4.9D and equation (f4.10|) imply that 

lim MPn) = HFip)) (4.11) 

n^oo 

when pn — > p with p^ € e„(S'"). We are assuming S is complete and 
separable, therefore so is V{S) |||]. 

We may now apply Lemma [4.3| with 



X = P(5), Z)„=e„(5"), /, 

and conclude that 



n — Yni 



hm / MOf^nidO = ^(Fip)) (4.12) 



for any sequence {/i™} that converges to 5{p) in V{V{S)). 
By equations (|7T|) and ( ^loD , 



<i,{F{p)) = lim / </)„(C)/in(dC) 
IV{S) 



n— >oo 



n— *oo 



lim / / (f>{r])Hn{C,d'r])fin{dO 
" IV{S) JV[T) 



n—roo 



lim / (f){ri) / Hn{C,dri)fin{dC), 
" IV(T) JV(S) 



for all (j) € Ci,{V{T)). This implies that 

i/„(C,dry)/in(dC) ^'^(i"(p)) 

in V{V{S)), completing the proof. ■ 

Theorem [4.1| states that the limit-law map F : V{S) — > ViT) must be 
continuous. If S is complete and separable then, conversely, any continuous 
map F is a possible limit-law map. This fact is a corollary of Theorem 4.2: 

Corollary 4.1 Suppose {S,ds) is a complete, separable metric space. Then, 
for any continuous F : V{S) — > V{T), there exists a sequence of Markov 
transitions {i^n}^i that propagates chaos, and for which 

is F{p)-chaotic whenever en(sn) — P in V{S). 
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Proof: 

Let F : 'P{S) — > V{T) be continuous. For each n and each s G Sn, let 
Kn{s, •) be the n-fold product measure 

Kn{s, •) := F(e„(s)) F(e„(s)) ^ • • • ® F(e„(s)). (4.13) 

Suppose the points s„ G S"" are such that e„(s„) converges to p as 
n tends to infinity. Since F is continuous , F(e„(s„)) converges to F{p) 
as well, so it is clear from Definition 3.2 that the sequence of symmetric 
measures {i^„(s„,-)} is F(p)-chaotic. By Theorem 4.2, {Kn} propagates 
chaos. ■ 

The Markov transition functions {Kn} may well be deterministic, that 
is, the n-particle dynamics may simply be given by a point-transformation 
from to T". These point-transformations are measurable maps from 
to T" that commute with permutations of coordinates. 

Let /„ : — > be a measurable map that commutes with permuta- 
tions of n-coordinates, i.e., such that 

fn{sTr{l),S^i2), - ■ ■ , Sn{n)) = VT • /„ (si , S2 , • • • , ^n) (4.14) 

for each point s G S"" and each permutation vr of the symbols 1,2, .. . ,n. 
Given /„, define the Markov transition Kn from to T" by 

Kn{s,E) = lEifn{s)) 

when s G 5" and -E G Say that {fn}'^=i propagates chaos if the 

sequence of deterministic transition functions {Kn} propagates chaos. 
The following is an immediate corollary of Theorem 'L2 : 

Corollary 4.2 (Deterministic Case) Let S be a Polish space, and for 
each n let fn be a measurable map from to T" that commutes with per- 
mutations as in ( 4-14 )- 

{fn} propagates chaos if and only if there exists a continuous function 

F : V{S) — > V{T) 

such that en(/n(sn)) — > F{p) in V(T) whenever en(sn) — > p in V{S). 
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Chapter 5 

Conclusion 



We have studied the propagation of chaos by famihes of Markov processes, 
having adopted a simple definition of propagation of chaos, namely, that the 
processes propagate all chaotic sequences of initial laws to chaotic sequences. 
Authors who wish to prove that certain families of processes propagate chaos 
often show only that sequences of initial laws of the form yO*^" are propagated 
to chaotic sequences, that is, they show that pure chaos is propagated to 
chaos. We have remarked that this does not imply unqualified propagation 
of chaos. 

Propagation of chaos, in its unqualified sense, entails the continuity of 
the limit dynamics. Families of Markov processes on Polish spaces propagate 
chaos if and only if the associated Markov transition functions satisfy the 
condition of Theorem 4.2. 

Our definition of propagation of chaos may be too simplistic to cover 
some situations of interest. For instance, the subtle propagation of chaos 
phenomenon that is operative in Lanford's validation of Boltzmann's equa- 
tion — where the chaos of the initial laws propagates if those laws have 
densities that converge uniformly — is not subject to our treatment here. 

Further foundational research on the propagation of chaos phenomenon 
of Lanford's theorem is called for. Is the phenomenon endemic to the 
Boltzmann-Grad limit, or is it, like the propagation of chaos that is the sub- 
ject of our theorems, a more general probabilistic phenomenon that should 
appear in other parts of kinetic theory? 
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